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ABSTRACT 

The purpose of this study was to (1) compare the 
semantic relationships among common nouns obtained via two different 
measurement procedures and (2) determine if the use of these 
relationships to classify the various words results in differential 
degrees of learning when the stimuli are cast in terms of the 
paired-associate learning paradigm. Three sample groups of 120, 60, 
and 320 consisted of volunteer undergraduate students. Results of the 
analyses showed that (1) Although the number of salient, semantic 
dimensions derived when scaling the stimuli via the semantic 
differential and multidimensional scaling procedures were basically 
the same, the specific interrelationships exhibited among the stimuli 
under the two procedures were quite different; and (2) When the nouns 
were used in a paired-associate learning task which incorporated both 
sets of relationships, significantly different levels of learning 
were observed. These results suggest that in learning situations such 
as this, the use of a multidimensional scaling algorithm may 
represent a more efficient procedure than the semantic differential 
for specifying the semantic interrelationships among small sets of 
verbal stimuli. (Author/JF) 
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Abstract 



Title of Project: An Analysis of the Semantic Relationships Among Words 

and Their Effect Upon Learning 

Principal Investigator: James M. Weber 

Contracting Agency: The Pennsylvania State University 

When certain of the problems associated with the instructional process 
are perceived in terms of communications theory, it is quite evident that 
a major problem facing educators is the measurement and evaluation of 
the semantic dimensions of message content. The purposes of the present 
study were to compare the semantic relationships among common nouns obtained 
via two different measurement procedures, and then, to determine if 
the use of these relationships to classify the various words resulted in 
differential degrees of learning when the stimuli were cast in terms of 
the paired-associate learning paradigm. 

-Tl^-^?esu-l-t-ant^analyses showed that (a) although the number of salient, 
semantic dimensions derived when scaling the stimuli via the semantic 
differential and multidimensional scaling procedures were basically the same, 
the specific interrelationships exhibited among the stimuli under the 
two procedures were quite different, and (b) , when the nouns were used in 
a PA learning task which incorporated both sets of relationships, signifi- 
cantly different levels of learning were observed. These results suggest 
that in learning situations such as the one considered the use of a multi- 
dimensional scaling algorithm may represent a more efficient procedure than 
the semantic differential for specifying the semantic interrelationships 
among small sets of verbal stimuli. 
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Introduction 



The Problem 

When instruction is viewed as possessing many of the characteristics 
of the -communications process it becomes evident that a major projlem 
facing educators is understanding the specific effects of different 
message characteristics and organizations upon the learner. In particular, 
since the majority of such messages are comprised largely of verbal 
elements, an important subproblem within this more general area of concern 
is understanding how students perceive such verbal elements as well as 
how these perceptions can be used to advantage in structuring messages to 
be employed in an instructional context. This subproblem basically in- 
volves the delineation of both the semantic and syntactic components of 
message content. 

The present investigation focused upon the former of these two com- 
ponents. Specifically, it dealt (a) with comparing several techniques 
for measuring students' semantic conceptions relative to a set of common 
nouns, and (b) with evaluating the importance of the interrelationships 
derived via these procedures to rate of learning, when the messages of 
interest contained only two basic, content elements. 

Related Research 

In order to better understand the implications and effects of differ- 
ent message elements upon a learner, it has been necessary for psycho- 
logists and linguists to engage in the measurement and evaluation of the 
semantic dimensions which learners use to characterize such elements. 

This concern has led to numerous theoretical, as well as operational, 
conceptions of what constitutes the "meaning" of a particular stimulis. 



With regard to words commonly used in the English language, the measure- 
ment of meaning has progressed from the development of familiarity 
estimates based upon frequency counts (Large and Thorndike, 1944) to the 
attempted determination of the dimensionality of an individual's conno- 
tative, semantic space via the semantic differential (Osgood, et al. , 
1957). More recently interested researchers have been employing various 
analytic techniques in an attempt to determine the most salient character- 
istics of word meaning as assessed via the different indices that have 
been developed. 

Paivio (1968), for example, factor analyzed a combination of 30 
different indicants of both learning and word meaning in an attempt to 
isolate the major dimensions present in his selected set of measures, and 
relate them to the verbal learning process. The six major factors to 
evolve were (a) concreteness-imagery, (b) impressiveness-complexity- 
emotionality, (c) familiarity-frequency, (d) specificity-preciseness, 

(e) associative variety, and (f) a learning, or ease of learning factor. 
This investigation, as well as others, suggest that word meaning is a 
complex, multi-faceted construct, which can serve as a powerful variable 
in the learning process (DeCecco, 1967; Staats, 1968). 

A major shortcoming of such studies has been the fact that most of 
the individual measurement procedures they have considered usually fail 
to adequately represent the multidimensional character of word meaning 
as perceived by the learner. In particular, the indices frequently used 
have had one or both of the following limitations in common: (a) they 

have been specifically designed to generate undimensional scales which 
result in the alignment of stimuli along a single continuum, thereby 



eliminating the possibility of a multidimensional construct emerging, 
and/or (b) they have involved procedures structured in such a manner 
that the post-analytic, semantic dimensions obtained may be confounded 
by the investigator's selection of scalar exemplars. The first of these 
problems is evident in the development of association norms which permit 
the respondents to make but one response to each stimulus, while the 
second can occur because of an experimenter's reliance upon a limited 
range of bi-polar adjectives when employing the semantic differential. 

The net effect of these limitations is that the procedures either directly 
or indirectly force the respondents to evaluate the stimuli selected for 
study in terms of an externally determined set of semantic dimensions, 
which may or may not be analagous to their implicit semantic schemes. 

A somewhat different methodological strategy for determining seman- 
tic structure is currently available in the form of multidimensional 
scaling. This approach circumvents the limitations noted above, since 
the respondents are not instructed to make their responses with regard to 
a particular dimension or set of structured scales. Instead, they are 
asked to respond only in terms of perceived similarities and/or differences 
among the stimuli being considered. Although this strategy can only be 
employed when dealing with a specified subset of verbal stimuli (common 
English nouns), it is conceivable that its application to the generation 
of relationships among the selected stimuli will better reflect the salient 
characteristics of the respondents' implicit semantic schemes than will 

other, commonly used techniques. 

The initial phase of the present investigation, therefore, was 
directed toward assessing the feasibility of employing such a multidimen- 
sional scaling procedure to define the semantic relationships among a set 



of verbal stimuli. The specific objectives were (a) to evaluate the 
dimensionality and semantic relationships existent among a selected 
set of common nouns for a sample of college students using Kruskal's 
multidimensional scaling algorithm (1964) , and (b) to compare the results 
obtained via this multidimensional scaling technique with those obtained 
using a modified form of the semantic differential, i.e., modified in 
the sense of employing a more heterogeneous set of bi-polar adjectives 
than is frequently used. 

The last part of the study was concerned with utilizing the results 
of the first phase to define relationships between the major components 
of selected, simple messages that contained only two content elements. 

Such a practice is in accord with the basic procedure used by psycholo- 
gists to further our understanding of the learning process. Specifically, 
the derived relationships were used to generate several sets of learning 
materials to be employed in making inferences regarding the activities 
utilized by learners in assimilating those materials. 

This same general procedure was utilized by Rohwer (1967), who in 
a series of systematic empirical investigations, has shown that embedding 
paired-associates (paired message elements) in semantically and syntact- 
ically structured verbal strings results in increased learning' efficiency. 

The basic types of message sets he employed were as follows: 

(a) the Standard Paired-Associate Paradigm 

noun (stimulus) - noun (response) : 

(b) the Verbal-String Paradigm 

adjective-noun (stimulus) - connective-adjective — noun (response) . 
In addition to the "elaboration" effects noted above, Rohwer has also shown 
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that the use of different form-classes of connectives in the verbal- 
string paradigm (e.g., conjunctions, prepositions, and verbs) differentially 
affects learners' rates of acquisition. 

These empirical findings have been assimilated in terms of the 
representational mediation model (Osgood, et al. , 1957), and the result- 
ant rationale (Weber, 1968) suggests: 

(a) If the cri tical nouns (elements) are presented contiguously 
the mere contiguity of association will cause the common 
mediating reaction characterizing the two elements in inter- 
action to eventually replace the mediating reactions 
characteristic of each element in isolation. 

(b) If the critical elements are presented in the context of 
semantically and syntactically structured strings during 
the input phase of the learning task, then the rate at which 
the interactive, mediating reaction comes to replace the 
reactions of each in isolation will be related to the form- 
class' of the connectives employed in the verbal strings. 

(c) If the critical elements are similar in "meaning" following 
the input phase of the learning process, the degree of 
similarity will be reflected in the rate of acquisition of 
the respective response elements as measured by test trial 
performance. 

(d) If connectives in verbal strings help to accelerate the rate 
at which the interactive, mediating reaction replaces the 
reactions to the elements in isolation, then the effects of 
connectives will be differentially affected by the nature of 
the learner's prior mediating reactions to the elements in 



isolation. 



The specific hypotheses derived from these theoretical suppositions 
and tested' in the second phase of the present study were: 

(a) Word pairs in which both elements are perceived by a sample 
of respondents as being relatively distant from the origin 
of the derived semantic space will be more readily learned 
than word pairs in which the elements are close to the 
origin of the space. 

(b) Word pairs in which the stimulus and response elements are 
viewed as being semantically similar by the respondents will 
be learned more rapidly than word pairs in which the elements 
are viewed as being dissimilar. 

(c) If the word pairs of interest are embedded in verbal strings 
with verb connectives for one group of subjects and presented 
in the standard paired-associate format for another group of 
subjects, on interaction between similarity of intra-word 
pair meaning and such a grouping will be observed. 

Procedure 

Design and Materials 

During the semantic description phase of the investigation a set of 
60 common nouns were randomly selected from a general list prepared by 
Osgood (1964) . These nouns served as the verbal elements considered in 
both phases of the study. One sample of 120 college students scaled 
these stimuli using the method of multidimensional rank order (Nunnally, 

1967; Torgerson, 1958), while a second sample of 60 students rated them 
on a modified form of the semantic differential. These two groups of 
respondents were selected via a systematic sampling procedure. 

% 
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Under both measurement procedures a sampling of stimuli similar 
to that suggested by Carroll (1959) was used. Specifically, the students 
assigned to the ranking task were required to rank order 59 stimuli in 
terms of their similarity to each of 15 randomly selected words. Thus, 
for each such respondent the resultant data consisted of 15 rank order- 
ings within each of which 59 of the nouns were ranked in terms of their 
similarity to a randomly designated noun. The composite set of data, 
which consisted of 30 rank orderings for each stimulus, were then cast 
in terms of a 60 x 60 similarity matrix, i.e., the average of the ranks 
assigned to each stimulus served as the columns of a similarity matrix. 
This matrix was then evaluated using Kruskal's nonmetric, multidimensional 
scaling technique to determine the dimensionality, scale values, and 
distances among the stimuli for the selected respondents (Krushal, 1964). 

The particular form of the semantic differential administered to 
the second sample of students contained 21 scales or sets of bi-polar 
adjectives. Three of these scales were related to each of the three 
factors noted by Osgood, et al. (1957), i.e., the evaluative, potency, 
and activity factors , while the remaining 12 scales were equally divided 
among four of the factors identified by Pavio (1968), i.e., the concrete- 
ness, complexity, familiarity, and specificity factors. The arrangement 
of words and scales paralleled that outlined by Osgood, et al. (1957). 
Hence, the data obtained from each respondent using this procedure con- 
sisted of ratings on 21 scales for each of 30 randomly selected stimuli. 
The composite data for each stimulus object (approximately 30 sets of 
ratings) were submitted to a correlational analysis, and sixty 21x21 
correlation matrices were generated. These sixty matrices were then 
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pooled, and the resultant composite, factor analyzed to obtain an estimate 
of the dimensionality of the semantic space for the second set of subjects. 
Factor scores for the 60 nouns were also obtained and used to calculate 
distance estimates among the stimuli. (The specific instructions and 
sample pages from the ranking and rating booklets used are contained in 
Appendices A and B, respectively.) 

Following the derivation of the two semantic structures comparative 
analyses were undertaken. First, since the two spaces generated were 
euclidean in form, polarity estimates for the stimuli (i.e., estimates 
of their distances from the origins of the derived spaces - an index of 
their "meaningfulness" (Osgood, £t £l . 1957)) could be computed and com- 
pared. The resultant hypothesis was viewed as a test of the similarity 
of polarity estimates evolving from the two procedures. If this hypothesis 
was not rejected, an hypothesis, formulated in terras of a test, and 
directed toward assessing the similarity of the inter— point distances gen- 
erated via the two approaches, was to be evaluated. Finally, the sets of 
scale values (factor scores in the case of the semantic differential) 
were submitted to a cluster analysis (Overall and Klett, 1972) to determine 
if the clusters of words generated using the two procedures were similar. 

Following these comparisons, the polarity estimates developed were 
used to divide the set of stimuli into two groups - a low polarity and 
a high polarity group. Both sets of polarity estimates were used, so 
there were now four groups of words - ranking, high and low polarity; 
rating, high and low polarity. Then, the scale values for the different 
stimuli were used to compute intra-word pair distances (or estimates of 
similarity of meaning) between the different word pairs within each of 
the polarity subgroups. Hence, for both the ranking and rating techniques 
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four different subsets of paired-associates were developed - low polarity, 
small intra-word pair distance; low polarity, large distance; high 
polarity, small distance; and high polarity, large distance. .In the 
learning phase of the study the two sources of these different classifi- 
cations of word pairs served as an independent variable, while cumulative 
responses to the different subsets during testing served as the multiple 
dependent variables . 

In order to incorporate the third hypothesis into the study a second 
independent variable was developed and crossed with the previous one. 
Specifically, for each of the levels of the initial variable two sets of 
materials were developed. In one set the standard paired-associate para- 
digm was used, while in the other each of the word pairs was embedded in 
a verbal string containing a verb connective. Finally, two blocking 
variables, one involving list variations (2 levels) and the other involving 
order of presentation (2 levels), were added. 

During the learning phases of the study each student was randomly 
assigned to one of the 16 cells generated via the preceding design. Under 
each of these conditions the students were presented a total of 20 paired- 
associates, 5 from each of the subgroups noted above. A 3:3-second rate 
of presentation with a 6-second inter-trail interval was used during each 
of two trails. Cumulative correct responses over these two trials for 
each of the four subgroups of word pairs served as the data for the second 
phase. (The set of instructions used to explain the learning task, as 
well as the accompanying examples, can be found in Appendix C.) 

Subjects 

The population of subjects for the study consisted of the undergrad- 



i 

[ 

I 

I 

f 

r 



r 

I . 



uate students enrolled in a basic educational psychology course. Although 
most of these students were education majors, they did represent a heter- 
ogeneous mixture of individuals from differing socio-cultural and educational 
backgrounds. The three samples consisted of 120, 60, and 320 volunteers, 
respectively, from this population. 

Results 

* 

Semantic Description Phase 

Since the major purpose of this initial phase of the investigation 
was to compare the semantic structures obtained via the multidimensional 
scaling and semantic differential procedures, the first analysis that 
were undertaken represented the attempts to assess the dimensionalities 
of the spaces generated under the two approaches. The results of these 
analyses are summarized in Figure 1, which illustrates the relationship 
between the number of dimensions considered and the respective, goodness - 
of-fit indices. 
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Figure 1 

The Relationship Between Dimensionality and Goodness-of-Fit Indices 

(a) Scaling Approach 
S .20 
T .18 
R .16 
E .14 
S .12 
S .10 
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Number of Dimensions 



10 
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13 



As indicated in Figure 1 the goodness-of-fit index employed with 
Kruskal's multidimensional scaling algorithm is stress. Specifically, 
the lower the stress value one obtains the better the fit of the derived 
space to the full space spanned by all the stimuli, with the ideal being 
a stress of zero. In applications of this criterion Kruskal (1964) 
suggests that the dimensionality of the derived space be designated by 
that abscissa where the stress curve begins to stop accelerating. Hence, 
in the present case the dimensionality of the derived semantic space 
using the scaling procedure was set at 7. 

In the case of the factor analysis involving the intercorrelations 
among the 21 scales used on the Semantic Differential, the dimensionality 
of the derived space was also set at 7. This decision was arrived at 
via the general role suggested by Kaiser (1958). Specifically, he has 
suggested that factoring cease when the last eigenvalue extracted becomes 
less than 1. In the present instance the eigenvalue associated with the 
7th factor was equal to .92. Although this procedure is not infallible, 
the representation presented, in Figure 1 shows that at an abscessa value 
of 7 the curve, for percentage of variance accounted for begins to stop 
accelerating much like the stress curve presented in the first part of 
the Figure. (The rotated factor matrix for the seven factors can be 
found in Appendix D.) 

The hypothesis concerning the similarity of polarity estimates 
generated via the two procedures was tested using the one-sample Wilcosan 
statistic. The results of this test are presented in Table 1. (See 
next page.) When computing this test statistic the actual polarity 

» 

estimates were replaced by their respective within method ranks and the 
resultant ranks compared, because of the inherent variations in the 



Table 1 



The Evaluation of Similarities in the Polarity Estimates 



N 


Sum of Negative Ranks 


1-Value 


P 


59 


656.5 


1.90 


.06 



magnitudes of the orginal polarity estimates. (The original polarity 
estimates are contained in Appendix E.) As seen in Table 1, the resultant 
analysis did not lead to a rejection of the hypothesis of similarity in 
polarity estimation using the two techinques. Since the value of the 
observed test statistic was so close to the critical value needed for 
rejection, an additional analysis was undertaken. In this analysis 
(Summarized in Table 2.) the stimuli were broken into high and low polar- 
ity subgroups for both scaling approaches, and the resultant data compared 
in terms of a contingency table. 

Table 2 

A Comparison of the Polarity Estimates 
Generated Via the Two Techniques 



High Polarity 

Rankings 

Low Polarity 



Semantic Differential 

High Pol. Low Pol. X- Value p 

16 14 13.06 .001 

14 16 



Due to the results evolving from the two preceding analyses it was 
concluded tha-t the classification of the set of words into high and low 
polarity subsets using the two procedures was not the same, i.e. , the 
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two procedures lead to different classifications for the stimuli. Since 
any comparisons among the inter-point distances generated under the tech- 
niques was dependent upon the existence of comparable classifications 
in terms of polarity levels, the evaluation of the second hypothesis 
described in the previous section was not undertaken. 

Although the second hypothesis was omitted, the cluster analyses 
were generated, using interstimulus distances to identify subgroups of 
stimuli (See Overall, J.E. and Klett, C.J., 1972). The results of these 
analyses are contained in Tables 3 and 4. 



Table 3 

The Clusters Evolving From the Analysis of 
the Semantic Differential factor scores 



Cluster //I 


Cluster 1t2 


Cluster it 3 


Cluster //4 


Cluster it 5 


respect 


rain 


smoke 


dog 


death 


woman 


hair 


pain 


heart 


hunger 


lake 


stone 


crime 


doctor 




s tory 


bread 


power 


tongue 




hope 


egg 


fire 


horse 




color 


Wednesday 


thief 


man 




freedom 


heat 


policeman 


girl 




future 


fruit 


guilt 


work 




friend 


chair 


fear 


cat 




sun 

knowledge 

sympathy 

head 

need 

star 


window 

smoke 

cap 


hunger 


river 




picture 




Cluster it 6 


Cluster it 7 


Cluster it 8 


choice 

relief 




house 


wealth 


laughter 


peace 

music 

progress 

marriage 




Wednesday 

map 


choice 

courage 


river 



Table 4 





The Clusters 
of 


Evolving From the Analysis 
the Scale Scores 




Cluster //I 


Cluster it 2 


Cluster it 3 


Cluster it 4 


Cluster #5 


hair 


rain 


smoke 


pain 


respect 


woman 


stone 


dog 


crime 


hope 


heart 


lake 


tongue 


fire 


freedom 


friend 


mop 


horse 


thief 


future 


man 

head 

girl 

laughter 

marriage 


river 


cat 


death 

policeman 

guilt 

fear 

smoke 


knowledge 

need 

choice 

power 

relief 

peace 

courage 

progress 



Cluster it 6 


Cluster it 7 


Cluster it 8 


Cluster 1t9 


Cluster #10 


bread 


color 


wealth 


doctor 


story 


egg 


sun 


house 


sympathy 


picture 


fruit 


heat 


chair 


death 


music 


hunger 


star 


work 


i 




cup 


picture 










window 









The most obvious differences between the results of the two cluster 
analyses is the numbers of multi-stimulus clusters generated. Specifically, 
the analysis of the factor scores produced via the semantic differential 
procedure yielded eight clusters, while the analysis of the scale scores 
yielded ten clusters. Also, with the semantic differential scores a 
major cluster with a number of minor clusters was evidenced, but with the 
scale scores the clusters were somewhat more homogeneous in size. Finally, 
visual inspection of the two sets of clusters suggests that those clusters 
evolving from the analysis of the scale scores are more homogeneous in 
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meaning and more easily describable than those evolving from the analysis 
of the semantic differential, factor scores. 

Learning Phase 

As indicated in the design section, in this phase of the study the 
procedure for generating mixed, paired-associate lists described by 
Weber (1968) was employed. Following this procedure, four distinct lists 
of paired-associates were developed. The results contained in Table 5 
show that these various lists contained the desired characteristics. 

Namely, the distances among the four subgroups of intra-list pairs could 
be ordered as follows: low polarity— small distances = high polarity-small 

distances < low polarity-large distances < high polarity-large distances. 

Table 5 



Comparisons Among the Intra-List Subgroups of PA’s 



Source 


List // 


Average Ranks 


of Subgroups 


2 








L.R-S.D. 


L.P.-L.D. 


H.P.-S.D. 


H.P.-L.D. 


X Value 


P 


Semantic 


1 


4.60 


13.20 


6.40 


17.80 


16.03 


<.01 


Differential 


2 


4.40 


13.00 


6.60 


18.00 


16.42 


<.01 


Multdimen. 


1 


4.40 


12.80 


6.80 


18.00 


16.06 


<.01 


Scaling 


2 


4.40 


12.80 


6.80 


18.00 


16.06 


<.01 



(The specific lists used are presented in Appendix F.) 

After the administration of these various lists a multivariate analysis 
of variance was undertaken. In this analysis the sums of the scores re- 
ceived by each student across two trials were computed, and the resultant 
sums for each of the subgroups of PA's served as the multiple criteria. 



The results of this analysis are summarized in Table 6. Although the 
results presented in that table may be conceptualized in a manner analo- 
gous to that used with a univariate analysis, the actual parameters heeded 
to describe the multivariate test statistic are different. (If questions 
concerning these differences exist, the reader should consult the article 
by Jones, 1966.) 

As evident in Table 6, the two different measurement techniques used 
in deriving the classifications for the different stimuli led to differ- 
ential rates of learning. In particular, the students learned the lists 
derived using the scaling procedure better than they did the lists de- 
veloped via the semantic differential. A more detailed analysis of the 
means on each of the dependent variables for each of these conditions, 

(see part of a Table 7) showed that the major cause for this difference 
was that under the scaling procedure the students learned the large distance, 
word pairs better than the students who received the large distance, word 
pairs derived using the semantic differential, independent of polarity level. 

The second major effect to reach significance was the list effect. 

In that instance the results showed that for some reason the first lists 
to be developed were easier than the second lists. The interpretation 
of this finding will be delayed until later, when an interpretation of 
the significant Procedure-List-Treatment interaction is discussed. 

Although the test of the Treatment effect was significant, the direc- 
tion of the observed differences was opposite that which would be predicted 
from the results obtained by Rohwer (1969). Specifically, in the present 
study the use of verbal strings was shown to have a deletarious effect 
upon learning. This effect occurred with each of the subgroups of paired- 
associates. (These means can be found in part b of Table 7.) 



Table 6 



The Summary of the Multivariate Analysis of 
Variance for the Learning Data 



Source of Variance 


dfl 


df2 


Mult.F 

Value 


P 


Measurement Procedure 


A 


293 


A. 58 


<.001 


Lists 


A 


293 


2.29 


<.06 


Treatments (Sent .vs coin.) 


A 


293 


3.80 


<.005 


Order 


A 


293 


.37 


<.83 


Proc. X Lists 


A 


293 


. 8A 


<.50 


Proc. X Trts . 


A 


293 


.37 


<.83 


Proc X Order 


A 


293 


1.29 


<.28 


Lists X Trts. 


A 


293 


.83 


<.51 


Lists X Order 


A 


293 


.60 


<.67 


Trts. X Order 


A 


293 


.20 


<.9A 


Proc. X Lists X Trts. 


A 


293 


2.88 


<.02 


Proc. X Lists X Order 


A 


293 


• 58 


< . 68 


Proc. X Trts X Order 


A 


293 


1.51 


<.20 


Lists X Trts. X Order 


A 


293 


.87 


<. A8 


Pore X Lists X Trts. X Order 
Grand Means 


A 


293 


.10 


<.98 


A 


293 


687.16 


<.0001 



The evaluation of the hypothesis dealing with the interaction between 
treatment conditions and intra-word pair distances was conducted using 
the different means generated when testing the treatment hypothesis. 
Specifically, a simultaneous confidence interval for a contract of the form: 

V ** ^P-SD, SENT.~ ^P-SD, COIN . ^ ~ ^HP-LD, SENT. ^P-LD, COIN^ * 

was established. This contract was not significantly different from zero, 
and as a result the hypothesis of interest could not be rejected. That is, 
a significant interaction between intra-word pair distance and Treatment 
.jas not found. 

As was noted earlier, another effect to reach significance in the 
multivariate analysis of variance was the Procedure-List-Treatment Inter- 
action. Inspection of the different means presented in part c of Table 7, 



especially the column denoted as "sums", suggests that for the two lists 
generated via the semantic differential procedure, the difference between 
the Sentence and Coincidental conditions was significantly greater for 
list 112 than for list #1, while for the lists developed via the scaling 
procedure, the difference between the Sentence and Coincidental conditions 
was greater for list ill than for list #2. These results when combined 
with the observed rejection of the hypothesis involving equality of per- 
formance for different lists, would seem to indicate that polarity and 
inter-point distance are not the only, and perhaps not even the major, 
determinants of inter-list variations. 

The last effect to be tested via the multivariate analysis of vari- 
ance was the grand mean. Although this particular test is not usually 
conducted under the univariate analysis of variance model, in the present 
context the significance of this result demonstrated that the means of 
each of the dependent variables were not equal to zero. Therefore, com- 
parisons among these means would involve quantities that were essentially, 
all nonzero. 

As in the case of the treatment- word group, interaction hypothesis, 
the hypotheses related to polarity levels and intra-word pair distance 
were evaluated via the establishment of simultaneous confidence intervals. 
(The four means being compared in these intervals were the grand means 
contained in part d of Table 7.) The two intervals of interest showed that 
(a) the students under all conditions did better on the word-pairs whose 
elements were most similar in meaning (i.e., they did better on the low- 
polarity small distance and high polarity-small distance subgroups than 
they did on the low-polarity-large distance and high polarity-large dis- 
tance subgroups) , and (b) performance on the two subgroups of high polarity 
word pairs (i.e., the high polarity-small distance and high-polarity-large 



i 

distance pairs) was significantly better than the performance on the two 
1 low polarity subgroups. Thus, these two hypotheses were confirmed by 

m the data. 



Table 7 

The Different Sets of Means Generated in the Learning Study 



Groups of Interest 



Part a 

I 






LP-SD 


LP-LD 


HP-SD 


HP-LD 


* Semantic Differential 




5.00 


4.56 


5.85 


5.01 


Scaling Procedure 




5.37 


5.08 


5.71 


5.81 


Part b 






LP-SD 


LP-LD 


HP-SD 


HP-LD 


] Sentence Condition 




4.83 


4.42 


5.44 


4.92 


Coincidential Condition 




5.54 


5.23 


6.12 


5.89 


* Part c 




SUMS 


LP-SD 


LP-LD 


HP-SD 


HP-LD 


j List 1 


Sent. 


21.24 


5.44 


5.01 


5.90 


4.90 




Coin. 


22.50 


5.35 


5.01 


6.49 


5.65 


* Sem. Diff • 
















Sent. 


16.23 


3.77 


3.41 


4.97 


4.08 


J“ List 2 


Coin. 


21.68 


5.45 


4.82 


6.03 


5.40 


List 1 


Sent. 


20.12 


4.98 


4.70 


5.28 


5.18 




Coin. 


24.87 


6.49 


5.74 


6.23 


6.41 


j Scaling 














List 2 


Sent. 


20.87 


5.13 


4.55 . 


5.63 


5.55 


r 


Coin. 


22.03 


4.89 


5.33 


5.72 


6.10 


1 

Part d 






LP-SD 


LP-LD 


HP-SD 


HP-LD 


Grand Means 






5.18 


4.82 


5.78 


5.41 
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Conclusions 



The findings involving the comparison of the semantic relationsips 
obtained using the two, selected scaling techniques showed that although 
both procedures produced the same number of semantic dimensions, the 
specific inter-stimulus structures generated were not very similar. With 
regard to the notion of polarity the two procedures were shown not to lead 
to the generation of comparable polarity estimates. Additional results 
evolving from the cluster analyses of the two structures revealed several 
ways in which they differed. Seemingly the most salient of these differ- 
ences was the greater homogeneity of meaning existent in the clusters 
generated via the scaling technique, i.e., clusters that somewhat resembled 
the kinds of convergent concepts described by Bruner, et. al. (1956). 

These findings suggest that such a scaling procedure might lead to the. 
evolvement of a semantic structure that is more consistent with behavioral 
conceptions of meaning than is the structure generated via the semantic 
differential. More research in this area, e. g. , norming and reliability 
studies must be undertaken, however, in order to evaluate this hypothesis. 

During the learning phase of the study three of the hypothesis of 
interest were supported. First, the students learned the word-pairs gen- 
erated via the scaling technique faster than they learned the word-pairs 
generated using the semantic differential results. One possible explana- 
tion for this finding is that the work-pairs generated via the scaling 
technique contained elements that were more homogeneous relative to their 
cluster membership than were the work-pairs generated via the semantic 
differential. Finally, the two hypotheses dealing with polarity and intra- 
word pair distance showed that performance on high polarity word pairs was 



greater than performance on low polarity word pairs, irregardless of 
intra-word pair distances, and that the small-distance word pairs were 
learned more rapidly than the large distance word pairs. These results 
confirmed the findings for children reported by Weber (1968), and suggest 
that when dealing with intra-word pair distance as an independent vari- 
able during learning a researcher must conceptualize that variable as 
being nested within a polarity level. More specifically, if polarity 
and intra-word pair distance are to be employed concurrently, then the 
later variable should be treated as being nested within the former 
variable. 

Although the present investigation was only exploratory in character 
the results suggest several directions for future research. First, the 
establishment of normative data for a wider variety of stimulus words 
using the selected scaling procedure could produce a valuable tool for 
further research into the effects of semantics on the learning process. 
More directly, the results suggest that in an instructional setting invol- 
ving simple messages, learning of the type considered should be improved 
if the semantic characteristics of the critical elements are properly 
arranged by the encoder or teacher. Such learning could be particularly 
valuable in developing and enhancing the semantic structures of deprived 
children presently being included in Headstart and Title I Programs. 
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The Ranking Booklet 



Instructions : 

The purpose of the test you are going to take Is to see what meanings 
different people have for certain words. When taking this test mark your 
answers In the appropriate spaces on the basis of the similarity of meaning 
of the different words as you view them . On the top of each page of your 
booklet you will find a different word and a set of 60 other words below It. 

You are to rank order these 60 words In terms of their similarity of meaning 
to the word provided at the top of the page. Note that the word at the top 
of each page is repeated In the listings. Always assign that word a rank of 
00 In your rank ordering. 

Here Is an example of how you are to rank the words in your booklet. Study 
this example carefully before proceeding. 

Suppose the following represents a page In your booklet , with 30 words 
In each of two columns. (The dots Indicate that 28 words In each column were 
skipped for this Illustrative example.) 

Mammal 



pear 



mammal 



car 



dog 



1. The first thing you should do Is mark the word mammal In the list by 
placing the rank of 00 In the associated spaces as follows : 

Mammal 0 0 



2. Now, suppose you feel that of the remaining 59 words the one most similar 
In meaning to mammal Is dog. If this Is the case, you should mark the 
spacer? after the word dog as follows: 

dog 0 1 or dog 1 

If you feel the word pear is the most similar In meaning of the remaining 
58 words to mammal, you should assign It a rank of 2 by filling in the 
associated spaces as follows: 

pear 0 2 or pear 2 

Finally, suppose you feel the word car of all the words presented Is most 
unlike mammal In Its meaning , then you should fill In the blank spaces 
after the word car as follows: 



An Example Pape 
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snake 

respect 

wealth. 

rain 

dog 

hair 

woman 

stone 

lake 

bread 

heart 

story 

hope 

doctor 

color 

tongue 

freedom 

house 

egg 

Wednesday 

future 

friend 

sun 

knowledge 

heat 

horse 

man 

sympathy 

fruit 

head 




girl 

chair 

map 

need 

star 

picture 

pain 

crime 

choice 

power 

belief 

laughter 

peace 

fire 

thief 

work 

cat 

death 

music 

river 

window 

policeman 

courage 

guilt 

fear 

smoke 

hunger 

progress 

cup 

marriage 
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Important : 

1. Be sure the rank, you assign to each word is clearly written. 

2. Be sure you rank each of the words in the list—do not omit any . 

3. Check your rank orderings for each word and be sure you have not assigned 
the same rank to two or more words. 

Please do not look back and forth through your booklet. Rank each word 
separately, and do not try to remember how you ranked similar words earlier 
in the test. 
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The P.ating Booklet 



Instructions : 

The purpose of the test you are going to take is to see what meanings 
different P people have for certain words. When takine this test. please mar 
your answers on the basis of what the words mean to you. 
this booklet you will find a different word and a set of 21 rating scales 
below it, you are to rate each word on each of these scales^ Her 
you are to use the scales: 

1 If you feci that the word at the top of the page la very closely related 
to one end of the scale, you should circle the nuuber above the space as 

follows : 



fair 



CPA _2_ 3 4 5 6 _7_ 



unfair 



or 



fair 



_1 2 3 4 5 6_ unfair 



2 If vou feel that the word is quite closely related to one or the other 
ends of the scale (but not extremely) , you should circle the nu er o 
numbers on the scales as follows: 



3. 



weak _1__ JL -L- JL _L_ strong 

weak 1 2 3_ 4 5 .<&JL strong 



If the word is only slightly related to one end of 
to the other end (but is not really neutral), then 
the appropriate numbers as follows: 



the scale as opposed 
you should circle 



4. 



fast _1 _ _2_ _4_ _5_ _6_ _7_ slow 

fast 1 2 3 ° 4 (5) ±_ _7_ slow 



E you think the word is neutral, or if you feel that a scale is SHgiiEiil 
related to a word, then you should circle the middle number as folio 



dangerous 1 2 3 (4) _J> 6 7__ safe 



Important : 

1. Completely circle the numbers you select. 

2. Be sure you circle a nuuber for each scale for each uord -do not omit an y 

3. Circle only one number for each scale for each word. 
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An Example Page 
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beautiful 


1 


2 


3 


4 


5 


6 


7 


- ugly 


passive 


1 


2 


3 


4 


5 


6 


7 


active 


familiar 


1 


2 


3 


4 


5 


6 


7 


unfamiliar 


vague 


1 


2 


3 


4 


5 


6 


7 


precise 


hard 


1 


2 


3 


4 


5 


6 


7 


soft 


abstract 


1 


2 


3 


4 


5 


6 


7 


concrete 


complex 


1 


2 


3 


4 


5 


6 


7 


incomplex 


dissonant 


1 


2 


3 


4 


5 


6 


7 


harmonious 


animate 


1 


2 


3 


4 


5 


6 


7 


inanimate 


weak 


1 


2 


3 


4 


5 


6 


7 


strong 


intangible 


1 


2 


3 


4 


5 


6 


7 


tangible 


uncommon 


1 


2 


3 


4 


5 


6 


7 


common 


specific 


1 


2 


3 


4 


5 


6 


7 


general 


elementary 


1 


2 


3 


4 


5 


6 


7 


advanced 


tenacious 


1 


2 


3 


_4_ 


5 


6 


7 


yielding 


simplistic 


1 


2 


3 


4 


5 


6 


7 


intricate 


good 


1 


2 


3 


4 


5 


6 


7 


bad 


immobile 


1 


2 


3 


4 


5 


6 


7 


mobile 


known 


1 


2 


3 


4 


5 


6 


7 


unknown 


theoretical 


1 


2 


3 


4 


5 


6 


7 


applied 


particular 


1 


2 


3 


4 


5 


6 


7 


indefinite 
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Sometimes you may feel as though you've had the same word before on the 
test. This will not be the case, so do not look back and forth through your 
booklet . Rate each word separately , and do not try to remember how you 
rated other words earlier in the test. Do not worry or puzzle over individual 
words. On the other hand, do not be careless, since we want to know what each 
word means to you. 
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APPENDIX C 



Instructions and Examples Used During the Learning Study 

Instructions-Sentence Condition : 

I am going to show you a series of unrelated sentences. In each 
one there are two underlined words. You are to learn the word pair in 
each sentence. I will test you by showing you the left-hand member of 
each pair and ask you to tell me the right-hand member. 

We will start with a practice set of ten sentences. You will see 
all ten of them, and then there will be a blank frame. The next slide 
will begin the test trial. You will see one of the left-hand words and 
should tell me what word went with it. Do you have any question? 

Ok, lets start. 

(Administer the practice list.) 

Now we wij. 1 Degm the actual task, inis list contaius 20 seuteuces 
like the ones you saw in the practice list. Do you have any additional 
questions? 

Ok, lets start. 

Instructions-Coincidental Condition : 

I am going to show you pairs of words, and you are to learn them. 
After you have seen all of the pairs. I will show you the left-hand 
member of each pair and ask you to say the right-hand member. 

We will star*: with a practice set of ten word pairs. You will see 
all ten word pairs, and then there will be a blank frame. The next slide 
will begin the test trial. You will see one of the left-hand words and 
should tell me what word went with it. Do you have any questions? 

Ok, lets start. 

(Administer the practice list.) 
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Now we will begin the actual task. This list contains 20 word 
pairs like the ones you saw in the practice list. Do you have any 
additional questions? 

Ok, lets start. 



Examples: 





Sentence Condition 




1 . 


The Hammer hits a Brick. 


1 . 


2. 


The Ocean washes the Tree. 


2. 


3. 


The Baby wears a Flower 


3. 


4. 


A City uses the Truck. 


4. 


5. 


The Bruise marks a Table 


5. 


6. 


The Worm sees a Light. 


6. 


7. 


The Shirt hold the Beans. 


7. 


8. 


A Clown fixes a Glass. 


8. 


9. 


The Chain scrapes the Arrow. 


9. 



1 A A nj i 
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Test Trial 
1 • Baby - (Flower) 

2. Shirt - (Beans) 

3. Piano - (Slime) 

4. Worm - (Light) 

5. Hammer - (Brick) 

6. Chain - (Arrow) 

7. Clown - (Glass) 

8. Bruise - (Table) 

9. City - (Truck) 
10. Ocean — (Tree) 



oxime. 10 , 



1. 

2 . 

3. 

4. 

5. 

6 . 

7. 

8 . 

9. 

10 . 



Coincidental Condition 

Hammer - Brick 
Ocean - Tree 
Baby - Flower 
City - Truck 
Bruise - Table 
Worm - Light 
Shirt - Beans 
Clown - Glass 
Chain - Arrow 
nano - si line 

Test Trial 
Baby - (Flower) 

Shirt - (Beans) 

Piano - (Slime) 

Worm - (Light ) 

Hammer - (Brick ) 

Chain - (Arrow) 

Clown - (Glass) 

Bruise - (Table) 

City - (Truck) 

Ocean - (Tree) 
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APPENDIX D 

The Rotated Factor Matrix for the Semantic Differential and the 

Derived Factor Names 



Rotatated Factor Matrix: (Loading less than .30 are omitted for* 

simpli city of interpretation.) 



Scales 


ft / 


T 


11 


III 


Fa- 

IV 


tors 

V 


VI 


VII 


1. 


Beautiful - Ugly 
















.80 


2. 


Passive - Active 






.31 


.30 




-.31 


.44 




3. 


Familiar - Unfamiliar 


# 


73 












.32 


4. 


Vague - Precise 






.66 












5. 


Hard - Soft 










-.65 








6. 


Abstract - Concrete 






.69 












7. 


Complex - Incomplex 






.35 












8. 


Dissonant - Harmonious 










-.58 






-.46 


9. 


Animate - Inanimate 














-.76 




10. 


Weak - Strong 






.47 


.31 








-.40 


11. 


Intangible - Tangible 






.58 












12. 


Uncommon - Common 


*** • 


68 


.36 












13. 


Specific - General 












-.74 






14. 


Elementary - Advanced 








.78 










15. 


Tenacious - Yielding 










-.75 








16. 


Simplistic - Intricate 








.81 










17. 


Good - Bad 
















.81 


18. 


Immobile - Mobile 














.60 




19. 


Known - Unknown 


# 


73 














20. 


Theoretical - Applied 






.59 












21. 


Particular - Indefinite 












-.74 
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APPENDIX D (cont'u) 



Factor Names: 



Factor 


Name 


% of Variance Accounted For 


I 


Familiarity 


8.93 


II 


Concreteness 


11.49 


III 


Complexi ty 


8.28 


IV 


Potency 


7.74 


V 


Specificity 


7.67 


VI 


Activity 


6.41 


VII 


Evaluative 


9.56 
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Polarity Estimates for the 60 Stimuli 



Ranking Ranking 

Stimulus SD Approach Approach Stimulus SD Approach Approach 



1. peace 

2 . future 

3. cup 

4. map 

5. bread 

6. power 

7 . chair 

8. girl 

9. stone 

10. fruit 

11. heart 

12 . courage 

13. freedom 

14. man 

15. wealth 

16 . snake 

n i 1 • « 

xi « xauguiCL 

18. knowledge 

19. pain 

20. doctor 

21. horse 

22. Wednesday 

23. crime 

24. dog 

25. woman 

26. belief 

27. smoke 

28. thief 

29. sympathy 

30. fire 



5.23 


2.45 


4.92 


2.08 


4.88 


2.66 


4.64 


2.84 


4.24 


2.69 


4.12 


2.53 


3.77 


2.94 


3.73 


2.18 


3.70 


2.84 


3.53 


2.77 


3.44 


2.32 


3.43 


2.37 


3.14 


2.32 


3.12 


1.81 


3.04 


2.33 


3.00 


2.62 


a r> 

X • UJ 


rs ^ A 

t • uu 


2.89 


2.26 


2.88 


2.50 


2.76 


1.81 


2.76 


2.31 


2.70 


1.57 


2.68 


2.60 


2.67 


2.58 


2.66 


1.99 


2.65 


2.51 


2.61 


2.86 


2.60 


2.50 


2.59 


2.49 


2.58 


2.73 



31. window 

32. head 

33. hair 

34. house 

35. egg 

36. policeman 

37. death 

38 . tongue 

39. guilt 

40. fear 

41. marriage 

42. cat 

43. hunger 

44. river 

45. star 

46. friend 
# - • 

4 / , J.CHN.C 

48. progress 

49. hope 

50. heat 

51. rain 

52. respect 

53. color 

54. picture 

55. music 

56. story 

57. sun 

58. choice 

59. work 

60. need 



2.48 


2.70 


2.47 


2.17 


.246 


2.20 


2.45 


2.66 


2.45 


2.68 


2.33 


2.42 


2.32 


2.69 


2.31 


2.72 


2.29 


2.64 


2.25 


2.56 


2.23 


2.46 


2.19 


2.17 


2.17 


2.47 


2.16 


2.66 


2.14 


2.44 


2.12 


2.22 


2 • 12 


2 . jo 


2.11 


2.23 


2.09 


2.27 


1.96 


2.68 


1.90 


2.50 


1.87 


2.36 


1.76 


2.13 


1.68 


2.26 


1.61 


2.73 


1.61 


2.50 


1.60 


2.49 


1.53 


2.43 


1.44 


2.07 


.95 


1.75 
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■ Lists Derived Using the Semantic Differential 



I 



I !• 


River - Work 


1, 


House - Music 


I 2. 


Policeman - Heat 


2. 


Head - Sun 


3. 


Egg - Window 


3. 


Policeman - River 


I 4 ‘ 


Color - Lake 


4. 


Marriage - Lake 


J 5. 


Fear - Hunger 


5. 


Need - Progress 



I 





L.P. - S.D. 




L.P. * S.D. 


i 1 - 


Hope - Tongue 


1. 


Egg - Fear 


1 2. 


Hair - Guilt 


0 

4 . • 


Cat - Guilt 


3. 


Star ~ Friend 


3. 


Work - Hope 


j t* 


Cat - House 


4. 


Death - Tongue 


1 5 - 


Rain - Progress 


5. 


Window - Friend 



I 





L.P. S.D. 




L.P. “ S.D. 


i *• 


rtatts — ruiuie 


i. 


cup - nreaa 


1 2. 


Fruit - Cup 


2. 


Sympathy - Woman 


3. 


Wednesday - Bread 


3. 


Man - Crime 


f 4 ‘ 


Smoke - Thief 


4. 


Fire - Snake 


1 5. 


Crime - Rain 


5. 


Knowledge - Belief 



I 







L.P. - S.D. 




L.P. 


- S.D. 


1 


i. 


Knowledge - Stone 


1. 


Doctor 


- Smoke 


1 


2. 


Girl - Power 


2. 


Rain - 


Future 




3. 


Dog - Courage 


3. 


Heart • 


- Chair 


r 


4. 


Fire - Map 


4. 


Fruit ■ 


- Peace 


1 


5. 


Snake - Freedom 


5. 


Stone • 


- Freedom 



I 



; ! 

i 

i 

o 

ERLC 
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Lists Derived Using the Scaling Procedure 



I 

I 

I 

I 



•[ 

r 

i 

i 



© 

ERIC 

r* 



L.P. - S.D. 



1. Cat - House 

2. Need - Work 

3. Policeman - Knowledge 

4. ' Heart - Sympathy 

5. Freedom - Respect 



L.P. “ S.D. 



1. Hair - Future 

2. Wealth - Star 

3. Picture - Hope 

4. Woman - Hunger 

5. Peace - Wednesday 



L.P. - S.D. 



1. Power - Death 

2. Fruit - Egg 

3. Fire - Sun 

4. Tongue - Snake 

5. Cup - House 



L.P. - S.D. 



1. Window - Belief 

2. Thief - Laughter 

3. Map - Rain 

4. Dug - Smoke 

5. River - Chair 



35 



<Y 



:8 



1. 

2 . 

3. 



1. 

2 . 

3. 

4. 

5. 



1. 

2 . 

3. 

4. 

5. 



1. 

2 . 

3. 

4. 

5. 



L.P. - S.D. 



Man - Head 
Respect - Courage 
Marriage - Hope 
4. Wealth - Future 

5 . Hunger - Need 



L.P. - S.D. 



Picture - Sympathy 
Cat - Knowledge 
Friend - Words 
Choice - Doctor 
Horse - Prograss 



L.P. - S.D. 



House - Bread 
Guilt - Fear 
Power - Map 
Sun - Lake 
Tongue - Dog 



L.P. - S.D. 



Snake - Music 
Stone - Belief 
Laughter - Crime 
River - Smoke 
Thief - Cup 



v 



